3D Computer Interaction Using Physical Objects: Exploration of Tangible User Interfaces

Why is computer interaction using a 3D CAD (Computer Aided Design) tool such a hard task while an untrained child can easily build 3D buildings out of a Lego set? We believe that the reason lies in the current Human Computer interface (HCI). TUIs (Tangible User Interfaces) offer natural means of interaction with computers and have already been shown to simplify existing computerized applications and offer solutions for tasks that were considered to be “out of the scope” of human-computer interaction. We are currently pursuing new applications for 3D geometry defining TUIs that can better exploit our innate abilities. In this paper we attempt to provide the reader with a brief overview of the underlying paradigms and research in this emerging domain. We also describe a TUI, the Segal Model, created by John Frazer and his colleagues 20 years ago and our current work in reviving this interface. We briefly present some of the initial results of building physical 3D worlds on top of the Segal Model and then rendering them into fully active 3D virtual worlds. Practical ways of enhancing the expressiveness of the interface and some of our future research plans are briefly presented.